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ABSTRACT 

Establishing and supporting a theoretical view in 
favor of assessment and evaluation as an adjunct to psychotherapy is 
clearly a difficult task in view of current anti-testing biases* But 
translating that viewpoint into practical terms within the 
environment of an emerging university can prove to be every bit as 
difficult. The current paper treats the rationale and techniques used 
to plan and implement a conceptual framework for human assessment in 
a systematic and effective manner at Sangamon State University. The 
approach used is innovative in that it cuts across programmatic 
boundaries to meet student needs while satisfying^ ^idministrative 
requirements for cost efficiency. (Author) 
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Abstract 

Establishing and supporting a theoretical view in favor of assessment 
and evaluation as an adjunct to psychotherapy clearly has proven to be a 
difficult task. But translating that viewpoint into practical terms within 
the environment of an emerging university has proven every bit as difficult. 
The current paper deals with the rationale and techniques used to plan and 
implement the conceptual framework outlined by my colleagues in a systematic 
and efficient mannei. 
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tVOLiri'lON OF THE CUKJULNT EVALUATION AND ASSESSMENT 
SEQUENCE AT SANGAMON STATE L^^IVE^wITY 

In contrast to the style utilized by my colleagues, I have chosen to 
utilize the case Btudy approach, applied here to an entire course sequence. 
No real attempt is made to tie our experiences into the literature f^r two 
reasons: first, because the omission of references promotes readability; 
and second, because little has been written regarding the nitty-gritty of 
implementation. 

Practically every institution of higher learning has had to deal with 
problems involving the instruction of evaluation and assessment oriented 
courses and sequences. However, the very fact of Sangamon State University's 
newness, its unusual character and the broal based configurations of its 
social science curricula combined to confront us with a series of problems 
that may presage the future. In short, it could very well be thac the same 
problems Sangamon State University has faced are Just waiting over the 
horizon for every institution offering instruction ii evaluation, testing, 
or measurement. 

A major problera confronting us at the inception of the University was 
whether to require courses such as Test and Me^aaurements in our variou^i 
social science progra!^ at all. The bias against testing is strong and 
influential elements within the student body, faculty and admj.nistration 
at SSU often championed a no-Cesting posture. Rather than assault this 
position on a purely theoretical basis, the "pro-testing faction" agreed 
initially to make Test ^d Heasurenients an elective in the UDC and 
Psychology. As expected, reality in the form of Job and advanced training 
demands shocked some of our early graduates so badly that the "anti-testing 
faction" surrendered the fortress without a prolonged struggle. They 
'<;sented their loss and still do, but reality makes a strong opponent. 



Having received cur half—hearted mandate^ it them becaske nticessary to 
develop an assessment sequence which would serve our students adequate? ly. 
Some of the problems we faced v/hich prevented a traditional approach included 
i.he following: 

1. Student populcitiou widely divergent in ability, education, exper- 
ience, and career goals. 

2. Limited instructional resources, requiring that classes be broad- 
based enough to encompass students from several programs and 
iutjl X ucliuMc*! levels. 

3. Instructional needs so diverse that faculty would have to be 
drawn from a wide variety of sources, including the private 
sector. 

4. The necessity of keeping overall class enrollments at acceptable 
University levels, i.e^p 18 students per class on the average. 

in view of these major constraints it became obvious early in the game 
that no one program could provide the needed resources nor could the 
traditional approaches to solving the problem utilized by established 
institutions be employed. The only rational solution appeared to be the 
development of a carefully monitored instructional systems approaches. To 
initiate this process, infortial meetings were held in the summer of 1973 
between faculty members and administrators from the affected 

programs to deten^ine the paraiaeters of the system which would have to be 
developed. An ad hoc committee cutting across program boundaries was 
also established at that time to monitor the systen^s progress. This 
committee with a somewhat changed composition continues to meet to this 
date. At the time of the original meeting the situation taced by SSU 
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would have been depicted in this manner: 



Source of 
Population 



Source of 
Instruction 



Outcomes Desired 
By Graduates 



Psychology 
fUndergrad & Grad) 




Psychology 




Graduate Study 



HDC (Grad) 



IIDC 



Public Sector Jobs 



General Social Science 
(Undergrad & Grad) 



Math 



Psychotherapy 



Allied Disciplines 



School Jobs 



Private Sector Jobs 



Personal Improvemen t 



If anything, the diversity pictured in the chart above is understated, 
so certain parameters become obvious at the outset* Granted unlimited re* 
sources, a possible solution might have been to have each, program provide 
highly specific instruction for its own students* But even this might rot 
have proved feasible becausi:. of the diversity of student Interests found 
within each program. Each program hai within its ranks discrete groups of 
students ranging in size from three or four each to fifty or more with 
differing personal and career goals. UDC for exaaple had students inter* 
ested in pursuing a Ph.D., others who were full-time teachers planning to 
remain in their cla^^srooms, and others entering careers in psychotherapy, 
to provide only a partial list of its special interests. Fortunately, 
analysis shoved that student Interests often cut across levels of Instruc* 
tlon and program areas; this made it possible to develop courses with 
potentially large student bases. 

For example, students in both HDC (a graduate program) anA Psychology 
(graduate and undergraduate) often were Intent on eventually becoming psycho* 
therapists. Additional students in several programs such as BDC, psychology. 
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sociology, and administration were Interested In careers at public agencies. 
These special interest groups thus forued an Integrating principle for 
decisions on final couri^e of fe rings • 

As an initial step the ad hoc committee designated one of its members 
as interim coordinator of dayto^day activities in the evaluation and 
assessment field for social sciences. This less than desirable honor 
which has since passed to a worthy successor entailed a number of nasty 
tasks such as setting up a test materials center and establishing waiting 
lists for high demand classes. This step relieved many persistent daily 
haFsles and provided a breathing space to all Involved. 

Proceeding from this point, the committee then decided to find the 
answers to three very pragmatic questions: 

I. What courses are needed to satisfy i^tudents needs? 

2» How often should specitic courses be offered? 

Who should teach these classes and how should they be taught? 

WnAT CCy^RSES AR£ NEEDED? 

This questions was answered primarily through a study of pro'^ramatic 
requirements an<i student career choices* 

A study of programmatic requirements indicated that in more than one 
instance minor revisions in the format of a course taught by one program 
would cause it to fully satisfy the requirements of a second or third 
program. A case In point was the basic psychological tests and measurements 
course. By broadening its scope and emphasizing practical applications of 
teat and measurement instruments and techniques, a revised i'ormat was 
arrived at %/hich satisfied the requirements of seversx progisms. This 
Btant that students from more than cm«: program could take the same basic 



course and receive prGgra::rD:iti c creJit for it via c ross list ing. 

Tlirough this step, a treriicndous amount of duplicated effort v;is 
clicLi.nated while nt tho saniti time coafusion resulting from a multip] j c i ly 
of course of fering;., was reduced. An ddoUlonal benefit lay In the f.ic {. 
th.it aon every program had to recruit Its cjwn evaluation faculty. IhJs 
wa:i especially critical at a linmt when the University was forced to hold 
th(.' line on faculty lecruitin^;, 

Wiilt perhaps a majority of student needs were satisfied by courses of 
a general nature such as this, a survey of students needs showed that 
certain needs were o\ a more specific nature. For example, teachers 
indicated a need for an evaluation course designed to aid them on the job» 
while individuals planning further graduate study cited a need for courses 
in testing theory or instrument development. Such courses were reasonably 
easy to justify, because the dem^^id was sufficiently high aid the course 
of such a nature that relatively high class enrollments could be maintained. 

Inla was not the case with highly specialized classes as individual 
testing cours s in intelligence, persoaaUty, or organic disorders. The 
demand for these courses was high due to stu'lent career needs but to meet 
accepted standards, er^rollment had to be kept to six to eight students per 
section. This In turn meant decreat^ed average class sizes and problems in 
satisfying administrators and governing boards. The question of how this 
was handled will be de«<lt with below, but suffice it to say at this point 
that the problems generated In meeting such highly specific student needs 
proved extremely serious. 

HOW OFTEN SHOULD SPECIFIC COURSES BE OFFERED ? 

Having determined what course^; were needed, the coomittee settled on 
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a varied approach to the question of how often to offer certain courses. 
Where specific courses were essential to the satisfactory completion of 
programmatic requi rem^fn t s , the detenninatior of how many course sectionii 
of that course to offer per term was relatively simple. Th- numoer of 
persons in each program was obtainable from Institutional Research flics 
and a simple ^tuden. ^luw model enabled us to project course demand with 
-,ome accuracy. Courses fitting this category were labeled high demand 
courses :ind two to tliree sections wf,re offered per term. 

Thf de-jaiid for courses designed to serve large subgroups within the 
programs such as teachers or prospective experimentalists proved soirewhar 
more difficult to estimate by logical means, but highly amenable to 
solution by trial ^ind error. Tliat is to say we offered "X" number of 
classes in <in area such as classroom evaluation per year. If overenrol led , 
we offered additional sections. If underenrol led. we cut back. By the 
end of the second year, we were able to estimate fairly accurately the need 
for classes in this category. 

In some cases, especially where the demand for a specific class was 
low or instruction in an area demanded expertise or equipment unavailable 
to the University, students were referred to other institutions. Our 
stance was not that such students did not have legitimate needs; rather it 
was that their needs could be better met by pna-exlstlng institutions. 

Finally, the question of how to handle high demand, low class size 
courses such as individual testing had to be dealt with. Here it was 
decided that financial exigencies demanded that a set nuinber of such 
classes be taught per semester and that a waiting list of Qualified candi- 
dates should be developed and maintained. The %rl6dom cf this approach 
became evident, despite the howls of frustrated students. 

9 
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S HUULU TK .ACM THt: CIJSSES AND HOW SHOULD 'HiEY BE TAUGHT? 

As the cypes c( classes needed and the number of sections desiivd jier 
semester or year becatnt' clarified, persons within the various program 
posse-ssing primary or becondary interests and aptitudes in the needed arenas 
were deterzdned. The vast majority of faculty in all programs willingly 
contributed to the joint effort. Wliere skills needed were not available 
wiuiin tho Universicy, part-time faculty were recruited. This proved 
particularly useful in several ways. It enabled is to obtain expertise 
wi could not normally afford to hire on a full'-time basis, whil providing, 
aii invaluable touchstone to the practical world in which our graduates 
eventually had to work. Also, it provided us with a valuable entre to 
potential practicum and internship placements. 

Through tiie employment of faculty from several programs and the use 
of part-time faculty, the course needs of most students were met promptly 
«ind expeditiously. At this stage of our development the course descriptions 
and formats were fairly well standardized but due to the multiplicity of 
programs and instructors involved, an unevenness In Instruction sometimes 
developed. In essence we were relying upon the standardization of course 
format to provide us with uniformity in instruction. 

So at stage two of the evaluation program's development, the system 
looked something like this: 

Source of Source of Types of 

Student Population: Instruction Curriculum Offerings: 



Special Interest Areas \ f All Affected Programs Plus Wl. Ck>neral High 

Within All Pr ogr ams / \ Part-time Faculty r\ Demand Courses 
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2. Moderate Demand 



3« Speciality Courses 



4. Low*Demand Courses 
(Other Institutions) 
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Tnis configuration, vhatever Its fault, worked reasonably well for a 
period of approximately two years. The improvenent over the old laissez 
faire system was signif ic^mt but carefully monitored feedback from students, 
faculty, administrator's and potential emplov^-/s obt^^ined by medns of 
surveys and studies led us to discover several inadequacies. Chief among 
the complaints were the following: 

1. IJnevenness in instruction. 

2. Lack of continuity in certain sequences of courses and undue 
overlap between courses. 

3. A poor fit between abilities of graduates and job requirements. 

4. A variety of administrative problems related to evaluation classes. 

5. Failure to meet accreditation requirements on the part of certain 
courses • 

Hie basic problem upon analysis appeared to be a lack of coordination 
In the instructiori and sequencing of course offerings to meet actual 
student needs. While using the special interest areas and course formats 
as integrating principles has helped overcotne several problems, it had 
resulting in a molecular class structure, in which each course stood alone 
and was not nocessarily integrated with related offerings. While this 
might have been a partially acceptable situation if the content of each 
class were completely standardized such forced standardization was not a 
practical or desirable outcome. 

The ultimate solution appeared to be the development of carefully 
structured course sequences designed to accomodfiite students from a variety 
of special interest areas and leading to highly specific outcomes. Putting 
this concept Into practice required first that rudimentary flow charts be 
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developed outlining the paths to be taken by individuals with varying 
career goals as thi y progressed through the evaluation sequence. Using 
the data gained from this process ^ steps then had to be taken to insure a 
smooth interface between each of the courses contained within a course 
sequence . 

baiiically thir involved 2 processes: First, each course had to be 
anal/zed and revised where necessary to insure that no serious gaps or 
overlaps in cours t content occurred and to insure that each course phased 
logically into the next. Second, adaiinistrative measures had to be 
instituted to assure a smooth flow of students through particular course 
sequences. An example of euch ar. administrative procedure was the 
development of an individual testing sequence in which no credit was 
granted until the entire sequence was completed. An additional procedure 
implemented was the assignment of specific course sequences to specific 
programs and clusters of instructors. Consequently the ultimate sydtem 
developed began to evolve in the manner indicated below: 



Source of 

Student Population 
Special Interest Areas 
Within All Programs 



Source of 
Instruction: 

/Clusters of full-tii»;:\ 
& part-time faculty \ 

^within affected pro- / 
trams / 



Types of 

Curriculum Offerings: 

:igical]y arranged course 
groupings designed to pre--* 
.pare students for specific 
\career goals ^ 



Reducing the concept to actual practice, let's trace the progress of two 
typical students with varying career goals as they progress thru the evalua- 
tion aspects of their training: 

1. Student A - Intends to become a psychotherapist in a clinical setting. 

2. Student B - Intends to become a school counselor. 



J2 



-10- 



Student A: Psychotherapist 



Non-ParaDe t ri c] 
Statistics I 
(Psych.) 



jPsych. Tests & 
1 Me a s u re oe nts_ 



(HDC) 



Ind. Testing j 

Sequence F 



Ind. Int, 
Testins 



Ind, Pers. [ 



Testin 



I 



jind. Test 

j Interpretation 



(Psych.) 



Testing for 
Organicity 
(HDC) 



Student B: School Counselor 



jQuantitatlve I 
(Psych. ) 



jPsych, 



Tests & 



1 Me as u reman ts 
(HDC) 





Research! 


jAdvanced Human 




Methods ! 


'Assessment 


(Psych,) 


(HDC) 



Certaiuly, the syateos developed have not proved foolproof. But judging 
from student and employer feedback, the end product has proven highly 
satisfactory. Suc^i results could not have occurred with an unsystematic 
haphazard approach to the evaluation seqxience. 
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